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We introduce a class of variational states to describe quantum many-body systems. This class generalizes 
matrix product states which underly the density-matrix renormalization group approach by combining them with 
weighted graph states. States within this class may (i) possess arbitrarily long-ranged two-point correlations, (ii) 
exhibit an arbitrary degree of block entanglement entropy up to a volume law, (iii) may be taken translationally 
invariant, while at the same time (iv) local properties and two-point correlations can be computed efficiently. 
This new variational class of states can be thought of as being prepared from matrix product states, followed by 
commuting unitaries on arbitrary constituents, hence truly generalizing both matrix product and weighted graph 
states. We use this class of states to formulate a renormalization algorithm with graph enhancement (RAGE) 
and present numerical examples demonstrating that improvements over density-matrix renormalization group 
simulations can be achieved in the simulation of ground states and quantum algorithms. Further generalizations, 
e.g., to higher spatial dimensions, are outlined. 
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Strongly correlated quantum systems give rise to a number 
of intriguing phenomena in condensed matter systems such 
as the existence of rare-earth magnetic insulators or high- 
temperature superconductors. The classical description of 
such quantum many-body systems is difficult, as entangle- 
ment and interactions cannot be neglected. A full solution 
of the underlying microscopic model is unfeasible due to the 
exponential growth of the dimension of the Hilbert space with 
the number of constituent particles. In turn, numerical vari- 
ational approaches, like the density-matrix renormalization 
group (DMRG) technique HI make use of an important 
observation. Typically, ground or thermal states do not oc- 
cupy the exponentially large Hilbert space, but a much smaller 
subspace. DMRG can indeed be seen as a variation over 
the polynomially sized set of matrix product states (MPS) 
fi 3, m 1^, approximating the true ground state iteratively. 
This approach is expected to work particularly well in one- 
dimensional gapped systems, in which correlation functions 
decay exponentially and the entanglement entropy saturates 
at larger block sizes, satisfying an "area law" |7]. 

Any such variational method, however, has its limitations. 
For example, in a critical one-dimensional system, the MPS 
description is no longer economical, with other variational 
sets potentially being more appropriate. When it comes to 
time evolution, area laws may be replaced by volume laws 
101, and a DMRG picture can become very expensive. Pro- 
jected entangled pair states (PEPS) form higher-dimensional 
analogues of matrix product states MPS 11211 . This approach 
is very promising but still in development. For critical sys- 
tems, multi-scale entanglement renormalization or contractor 



renormalization llOlll 111 are promising candidates also in two 
dimensions, but are not easily reconcilable with translational 
mvariance. Weighted graph states (WGS) iH [m .15] are a 
family of states that can embody long-range correlations in 
any spatial dimensions, but do not seem to grasp short-range 
properties as well as MPS do 1 16]. 

With these observations in mind, one of the key questions 
seems to be the following. How far can one go with the ef- 
ficient classical description of quantum many-body systems? 
Can MPS for example be generalized to a larger class of states 
encompassing some of the above approaches while retaining 
all of their convenient features? Can one have additional long- 
range correlations while still being able to efficiently com- 
pute local properties and correlation functions? In particular, 
given the complementary strengths of the MPS and the WGS 
approach it is natural to attempt a unification of the two ap- 
proaches. This work shows that indeed the two pictures can 
be combined to form a new enlarged variational set, while re- 
taining all of the desirable structural elements of its ancestors. 
We first define the set, discuss variations, sketch generaliza- 
tions and finally demonstrate applicability and performance 
as well as limitations in ground state approximations and sim- 
ulations of quantum algorithms. 

Renormalization algorithm with graph enhancement. - We 
start from MPS of a quantum chain of length N, consisting of 
d-level systems, as used in DMRG flllllll] 
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where the yll"^ are complex Dx D matrices. For open bound- 
ary conditions, the left- and rightmost matrices can be taken 
to be vectors. For simplicity of notation, but in a way that can 
be trivially generalized, we now fix c? = 2. MPS have correla- 
tion functions (Z^-^) z(J+'''>) - exponentially 
decaying in k and satisfy an area law 101 by construction lfl9ll . 
An area law in ID implies that any Renyi entropy Sa of the 
reduced state of a block of L contiguous spins will eventually 
saturate {Saiph) = 0{1))\ many ground states possess this 
property and hence a good and economical MPS approxima- 
tion of them is possible |8]. 

Now we go beyond this picture and apply to the MPS any 
set of commuting unitaries between any two constituents, ir- 
respective of the distance. More specifically, we consider 
the adjacency matrix $ of a weighted simple graph with 
^k.i G [0, 2tt) and apply without loss of generality the corre- 
sponding p/ia^e gafe,? ;7($fe,i) := |0,0)(0,0| + |0, 1)(0, 1| + 
|l,0)(l,0| + |l,l)(l,l|e**'='' between the particles fc , Hn the 
chain. Finally, we apply local rotations Vj G U{2), to arrive 
at the variational class of states defined by 
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which then forms the basis of the renormalization group algo- 
rithm with graph enhancement (RAGE). The above set clearly 
embodies a large variational class. By definition, for $ = 
and Vj = 1, it includes the MPS. It also includes superposi- 



tions of WGS as first considered in Ref. lllSIl 
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™ "|1} and U{^m,n) are defined as above, and which 
can be shown to be of the form of Eq. (|2]i. For simplicity, and 
w.l.o.g, we will often set Vj = 1 subsequently. 

Main properties of RAGE states. - To start with, RAGE 
states have a polynomially sized description, where the MPS 
and the WGS part are fully determined by 0{ND^) and 
0{N'^) real parameters respectively. Furthermore 

(i) Volume law for the entanglement entropy: By having a 
collection of maximally entangled qubit pairs across a bound- 
ary, the von-Neumann entropy of a block of length L can be 
taken to scale as S{pl) = 0{L). Encompassing graph states, 
our class can hence maximize the entanglement entropy. 

(ii) Translational invariance: Whenever the MPS part is 
translationally invariant, $ is a cyclic matrix, and Vj is the 
same for all j, the whole state \ip) is manifestly translation- 
ally invariant. There exist other translational invariant states 



that do not have this simple form. The key feature, though, is 
that unlike for multiscale entanglement renormalization ifioll . 
there exists this natural subset of states for which translational 
invariance is guaranteed to be exactly fulfilled, while at the 
same time a volume law for block-wise entanglement is pos- 
sible lElH. 

(Hi) Completeness: As MPS already form a complete set 
in Hilbert space (if one allows D to scale as 0(2^), one can 
represent any pure state in ((D^)®^) and this remains true for 
the RAGE set. 

Efficient computation of local properties and correlation 
functions. - The previous properties are all very natural and 
desirable, and especially (i) cannot be achieved efficiently 
with MPS alone. However, as will be shown, this does not 
prevent us from computing local properties and correlation 
functions efficiently - which is the key feature of this set. 

To compute expectation values of observables with small 
support we use the relevant reduced density matrix ps, which 
may be computed efficiently with an effort of 0{ND^) in 
the total size N of the system S C {!,..., N}. Controlled 
phase gates acting exclusively on qubits that are traced out 
make no contribution, while those that act on the spins in 
S = {mi , . . . , r7i|5| } amount to a redefinition of the observ- 
ables that are local to S. Therefore we redefine $ such that the 
above simplifications are enforced, oj^^i — $fe ;iffc G S,l G 
5 or fc G 5, ; G 5, where § = {I, . . .\n}\S, and ujk,i = 



otherwise. We also define E 
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where * 



denotes complex conjugation. The reduced density matrix ps 
(up to phase gates in S) is then found to be 
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The key of the above argument is that the effect of the phases 
is a mere modification of the transfer operators of the MPS 
by a phase factor, the phase depending on the matrix element 
in question. Thus, the evaluation of expectation values is per- 
formed using (products of) transfer operators associated with 
the single sites. The reduced state can then be written as 
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where now Tif',lj{s™p, r„p}) := E^^'^r^ if fc G 5, which 
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are the unmodified transfer operators of MPS, and 

1 

1=0 

if fc G iS, which are the transfer operators modified by 

phases, bI'\{s„,^},s,) 4'^ U„.^eS ■ 
Grouped in this way, the reduced density operator can in- 
deed be evaluated efficiently. In fact, for each {r™ , Sm } 
the effort to compute the entry of the reduced state is merely 
0{ND^), as one has to multiply N transfer matrices of di- 
mension X Z?^, just as in the case of MPS. This procedure 
is inefficient in |iS|, with an exponential scaling effort. How- 
ever, any Hamiltonian with two-body (possibly long-ranged) 
interactions can be treated efficiently term by term. 

Efficient updates. - Besides procedures for the efficient 
computation of reduced density matrices, and therefore ex- 
pectation values, we need a variational principle to improve 
the trial states. We will focus on local variational approaches 
to approximate ground states by minimizing the energy 

^ (V>(A,$,y)|g|^(A,$,T/)) 

on the approximation of time evolution and on the simula- 
tion of quantum circuits. The search for ground states is well 
known to be related to imaginary-time evolution. 

Static updates. - The MPS part can be up- 
dated as in variants of DMRG |6]. The expression 
$,!/)) is (as in MPS) a quadratic 

(k) (k) 

form in each of the entries of the matrices Aq , A\ for 
each site k = 1, . . . ,N. An optimal local update can there- 
fore be found by means of solving generalized eigenvalue 
problems with an effort of 0{D^). Local rotations can be 
incorporated by parametrizing single qubit rotations on spin 
k with real parameters Xk E R'' as Vk = J2'j=i^k,jMj 
with AI = {l,az,(Jy,ax) being the vector of the Pauli 
matrices including the identity. Again, the local varia- 
tion of Xk in (|4| is a generalized eigenvalue problem in 
Xk for each site k — 1, . . . ,N. To optimize the phases 
of the WGS, one may first define the new Hamiltonian 

Hv ■■= {Uf=iVj'^^)H{Uk=iV^''')- The optimal phase 
gates between any pair of spins j,k e {!,..., N} can be 
computed efficiently as the procedure amounts to a quadratic 
function of a single variable z = e**^ '". To summarize, 
an update of \tp{A,^,V)) to minimize ^ corresponds to 
a sweeping over such local variations, each of which is 
efficiently possible, with an effort of 0{MND^) for M 
sweeps. An element that is not present for MPS alone is that 
one can make a choice whether one adapts an MPS part or 
the adjacency matrix for an identical change in the physical 
state. In practice, we have supplemented this procedure with 
a gradient-based global optimization, making use of the fact 
that the gradient can be explicitly computed. 



We have applied the RAGE-method to proof-of-principle 
ID and 2D models, where the adjacency matrix is allowed 
to connect any constituents in the lattice. Fig. [Ha) shows re- 
sults for the 2D Ising model with transversal magnetic field, 

H = I](Q,b) o-i^'crf^ + SX^a'^^"''' comparing the achiev- 
able accuracy of MPS (using a one-dimensional path in the 
2D lattice) and the RAGE-method for a fixed total number 
of free parameters. The RAGE-method gives a significantly 
better accuracy regarding ground state energy and two-point 
correlations, already for a very small number of parameters. 
For other models, we see a similar improvement of RAGE 
over MPS, although in some cases (e.g., for a 2D Heisenberg 
model) the overall accuracy is still not very satisfactory, pos- 
sibly related to local minima encountered in the procedure. 
This new class of states does allow for new features like long- 
range correlations and a violation of an area law, but in turn, 
breaks the local SU{2) gauge invariance. It is also clear from 
the simulations that the limitation of the underlying ID struc- 
ture of the MPS cannot always be fully overcome by the graph 
enhancement. The full potential in numerical performance in 
identifying ground states is yet to be explored. There exist, 
however, a number of interesting parent Hamiltonians where 
the RAGE method should be particularly well suited, e.g., per- 
turbations of models which have a WGS as an exact or ap- 
proximate ground state. We mention Kitaev's model (and per- 
turbations thereof) on a hexagonal lattice which has the toric 
code state - a WGS - as ground state. 
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Figure 1 : (a) 2D Ising model on a 4 x 4 periodic lattice . We compare 
the achievable accuracy with RAGE (red, solid) and MPS (green, 
dotted) with D = 4 with exact results (blue, dashed). Two-point 
correlations as function of B are shown. The inset depicts the energy 
for different total numbers of parameters and B = 2 in comparison 
with the exact ground state (blue, dashed) as well as the first excited 
state (light blue, dashed), (b) Comparison of MPS (blue, dashed) 
and RAGE (red, solid) with D = 2 for the simulation of a random 
quantum circuit 1,17.1 on A*' = 14 qubits. Application of a random 
local phase gate followed by a random controlled-phase gate with 
random uniform phase in [0, 27r) constitutes one block. For given k 
we apply this block k times to a randomly chosen initial MPS state. 
500 such runs are determined, and in each the fidelity with the exact 
state is computed. The average over 500 realizations is then plotted. 

Time evolution and simulation of quantum circuits. - We 
have also considered time evolution, more specifically the 
evolution of a quantum state in a quantum circuit. Here, se- 
quences of elementary gates are applied, e.g., two-qubit phase 
gates and arbitrary single-qubit rotations. This method can be 
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easily adapted to Hamiltonian (real or imaginary) time evo- 
lution. We now show how to efficiently obtain an optimal 
approximation of the resulting state after the application of an 
elementary gate. It turns out to be useful to restrict the vari- 
ational family by setting Vj = 1, although an extension to 
arbitrary V is possible. For phase gates, this update is partic- 
ularly simple, as only a change in the adjacency matrix $ is 
required. It is part of the strength of the scheme that phase 
gates between arbitrary constituents are already included in 
the variational set. The update of a local unitary will require 
some more attention: 

Consider an initial state vector | $, 1)}, to which a sin- 
gle qubit unitary operation U is applied - acting, e.g., on the 
first qubit. The goal is now to find the best approximation 
\iIj{A' , 1)) which maximizes 

^ mA',^',i)\uimA^,m' ... 
• (v^(A',$',i)iV'(A', $',!)) ■ 

It appears natural to vary only phases that directly affect qubit 
1, i.e., ^'j J, = k if j 7^ 1. In this case, one can rewrite (|5]l 
in such a way that the optimal MPS part A' can be obtained 
analytically by solving a set of linear equations, while the op- 
timization of a single phase ^[ leads to a simple quadratic 
form. In practice, an alternating sweeping of both kinds of 
local variational methods is required. We have tested this 
method for a random quantum circuit (see Fig.lTJb)) and com- 
pared the achievable accuracy with MPS. Again, we obtain an 
improvement due to the WGS. Extensions. - A similar con- 
struction as illustrated for MPS also works for unifying WGS 
with other underlying tensor network descriptions. Similarly, 
one can use arbitrary Clifford circuits instead of the WGS and 
can still efficiently contract. More precisely, whenever an ex- 
act or approximate evaluation of expectation values of arbi- 
trary product observables (i.e., tensor products of local opera- 
tors) for a state described by a tensor network is possible, then 
local observables (i.e., observables with a small support) can 
be efficiently computed for the unified family of such tensor 
network states and WGS (or Clifford circuits), following an 
approach similar as in Eq. (|3]l. While this certainly restricts 
the set of computable quantities (e.g., string-order parameters 
can no longer be evaluated), it still suffices to compute expec- 
tation values of all local Hamiltonians and hence one obtains 
a variational method for a ground-state approximation or sim- 
ulation of quantum circuits. 

Conclusions. - To summarize, we have introduced a new 
variational class of states to describe quantum many -body sys- 
tems. These states have a number of desirable properties. Cor- 
relation functions can be computed efficiently, systematic im- 
provements of the approximation within the class are possible 
and the states carry long-range correlations and violate entan- 
glement area laws, as being encountered in critical systems or 
in quenched quantum systems undergoing time evolution. We 
have applied the RAGE ansatz to condensed matter and quan- 
tum computation problems, where we find an improvement 



over MPS. From a fundamental perspective the key question 
is where exactly the boundaries for the efficient classical de- 
scription of quantum systems might lie. In fact, intriguingly, 
the entanglement content of the state cannot be taken as an 
indicator for the "complexity of a state" [Tsl]. Delineating 
this boundary will reveal more about the structure of quan- 
tum mechanics from a complexity point of view and holds the 
potential for new improved algorithms and methods for the 
description of quantum systems. 
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